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(57) Abstract: Image sharpening is performed y applying 
variable contrast stretching to pixels of interest in a digital 
image. For each pixel of interrest, the amount of contrast 
stretching is a function of minimum and maximum inten- 
sity values in a local pixel neighborhood. 
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IMAGE SHARPENING BY VARIABLE CONTRAST STRETCHING 

BACKGROUND OF THE INVENTION 
5 The present invention relates to digital images. More specifically, tiie 

present invention- relates to image sliarpening. 

image sliarpening is performed to improve the appearance of digital 
images and particulariy the legibility of documents. One well-known image 
sharpening technique is unsharp masking. 

10 However, traditional unsharp masl<ing enhances perceptible noise in 

sharpened Images. For instance, the unsharp masking enhances iow- 
ampiitude noise in scanned images and captured photographs. In addition, 
traditional unsharp masking does not avoid overshoot at edges. Overshoot 
can be especially troublesome if a digital Image is interpolated. The overshoot 

15 is spatially spread by the interpolation and appears as an artifact in the 
inteipolated image. 

Modifications to traditional unsharp masking have been made to reduce 
the perceptible noise and avoid the overshoot. However, the modifications do 
not address imperceptible noise, which reduces the compressibiiity of the 

20 sharpened images. Moreover, modified unsharp masking techniques that 
avoid overshoot are usually slower to perform. 

Another image sharpening technique, known from morphological 
filtering theory, is toggle mapping. Toggle mapping is usually effective for 
sharpening text-based Images containing edges between black text and white 

25 background. However, toggle mapping is not as effective for sharpening image 
regions that are not purely black and white, in such regions, the toggle 
mapping tends to oversharpen textures and natural {e.g., photographed) 
features. The toggle mapping also tends to enhance noise, although not as 
much as traditional unsharp masking. Moreover, the toggle mapping tends to 

30 produce jagged edges in text in low-resolution images (In low resolution 
images, the text looks better when smoothed by anti-aliasing). 
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SUMMARY OF THE INVENTION 
According to one aspect of the present invention, a digital image Is 
sharpened by clipping those pixel intensity values outside of a variable range; 
and mapping those pixel intensity values within the variable range. This 
5 technique improves image quality without enhancing low-amplitude noise in an 
image, and it avoids overshoot. 

Other aspects and advantages of the present invention wili become 
apparent from the following detailed description, tal<en in conjunction with the 
accompanying drawings, illustrating by way of example the principles of the 
1 0 present Invention. 

BRIEF DESCRIPTION OF THE DRAWINGS 
Figure 1 is an illustration of variable contrast stretching; 
Figure 2 is an illustration of a neighborhood of pixels for the variable 
1 5 contrast stretching; 

Figure 3 is an illustration of a method of sharpening a digital image by 
variable contrast stretching; and 

Figure 4 is an illustration of a hardware implementation of variable 
contrast stretching. 

20 

DETAILED DESCRIPTION OF THE INVENTION 
As shown In the drawings for purposes of illustration, the present 
invention is embodied in a method and apparatus for sharpening an image by 
variable contrast stretching. The variable contrast stretching reduces spatial 

25 scale of large gray-level transitions, resulting in a considerable sharpening In 
features that are computer-generated (e.g., text, CAD drawings). The variable 
contrast stretching only mildly reduces the spatial scale of milder gray-level 
transitions, resulting in a milder sharpening of features that are "natural" (e.g., 
photographed features). Thus, the variable contrast stretching applies strong 

30 sharpening to computer-generated features and mild sharpening to edges in 
natural features. The variable contrast stretching improves the appearance 
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and legibility of compound documents containing botli natural and computer- 
generated features. However, the spatial scale for weak gray-level transitions 
is essentially unchanged. 

The variable contrast stretching avoids overshoot. Thus, overshoot- 
5 related artifacts do not appear as the result of interpolation of digital images 
that have been sharpened by variable contrast stretching. 

The variable contrast stretching does not enhance low-amplitude noise. 
In fact, it can slightly reduce low-amplitude noise. Because the variable 
contrast stretching does not increase low-amplitude noise and it avoids 
10 overshoot, compressibility of the sharpened image is not reduced relative to 
the original image. Consequently, a digital Image may be sharpened only 
once, prior to compression, thus avoiding the need to sharpen the image each 
time after decompression. 

The variable contrast stretching can work in raster-scan mode with an 
15 upper bound on the number of operations per scan line. This makes it 
suitable for real-time operations. 

Reference is made to Figure 1, which illustrates variable contrast 
stretching for a digital image. The digital image Is made up of a plurality of 
pixels, each pixel being represented by an intensity value. A point-wise 
20 contrast stretching operation g(I) is performed on each pixel of interest as 
follows. 

\I-A<-W m 



8(1) = 



I-A>W M 



The pixel of interest is modified with respect to a neighborhood of 
pixels. The gray-value or intensity of the pixel of interest is denoted by the 
25 letter I Maximum gray-value of the neighborhood is denoted by the 
uppercase letter M, and minimum gray-value of the neighborhood is denoted 
by the lowercase letter m. The local dynamic range of the neighborhood, 
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denoted by the letter D, is the difference between minimum and maximum 
values of the neighborhood (that is, D=M-m). 

A "contrast range" has a width of 2W. The contrast range is centered 
about the middle (A) of the dynamic range. A = (M+m)/2. Thus, the contrast 
5 range has a starting point at A-W and an ending point at A+W. 

If the intensity value of the pixel of interest is outside of the contrast 
range, the intensity value is clipped to either m or M. If the Intensity value of 
the pixel of interest lies within the contrast range, the amount by which the 
local contrast is changed is determined by the gradient of the slope of a line 
1 0 segment 1 0 within the contrast range. 

The slope of the line segment 10 is a function of the dynamic range. 
The slope, denoted by S(D), is related to the contrast range and the dynamic 

range as follows: S(D) = ^^. In general, the slope complies with the 

following: the slope approaches unity as the dynamic range approaches 0 (i.e., 
15 S(D)-^1 as D— >0); the slope Is greater than unity when the dynamic range is 

greater than zero (i.e., S(D)>1 when 05^:0), and the slope Is a non-decreasing 

function of the dynamic range. As the dynamic range increases, the slope 

becomes larger and the sharpening increases. 

Thus the slope is a function of the dynamic range and the contrast 
20 range of a given pixel neighborhood. Because a neighborhood is determined 

for each pixel, the dynamic range, the contrast range and the slope are 

variable on a pixel-by-pixel basis. 

There are many different ways of expressing the slope of the line 

segment 1 0. For example, the slope may be expressed as follows. 

25 5(Z)) = — + — 

2W R 

where constant R is a single global parameter that controls corresponds to the 
dynamic scale for sharpening. This also defines the contrast width (2W) as a 

function of the dynamic range (D): W = — Thus the variable 

contrast stretching operation within the variable contrast range may be 
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expressed as follows. 

g(/)=7-l-^(/-A) {|/-A|<W} 

If D»R, the mapping becomes equivalent to toggle mapping, wliereby edges 

are oversharpened. Proper selection of tlie constant R prevents such a 
5 problem. For neighborhoods having small dynamic ranges, D«R and 1+D/R «= 

1 . Therefore, no effective change in contrast will occur for D«R. 

The constant R may be limited to powers of two for computational 

efficiency. Since the quantity 1+D/R involves a division by the constant R, 

limiting the constant R to a power of two allows the division to be performed 
10 simply by bft-shifting. Thus R=^, where integer L>0. As the constant R 

decreases, the sharpening effect increases since the contrast region is smaller 

and the slope of the contrast stretching becomes larger. 

For pixel intensity values that are represented by 8-bit words, the 

preferred value of R is between 64 and 512. That is, 6 < L 5 9. More 
16 generally, If the dynamic range of the entire image is normalized to cover the 

complete dynamic range of the capturing device (e.g., scanner), the preferred 

value of R is between one-quarter of the dynamic range and twice the dynamic 

range. 

Reference is now made to Figure 2, which illustrates an example of a 
20 neighborhood of pixels. The neighborhood, delineated by a window indicated 
in dashed lines, includes a 3x3 array of pixels. The pixel of interest, marl<ed 
by an "X," lies at the center of the neighborhood. Thus, the function g(I) is 
applied to the center pixel (marked by the "X") and the dynamic range is 
determined by the minimum and maximum intensity values of the pixels lying 
25 within the window. If, for example, the pixel intensity values are represented 
by 8-bit words, the lowest intensity value of the pixels in the neighborhood is 
m=5 and the highest intensity value of the pixels in the neighborhood is 
M=250, the dynamic range is D=245 for that neighborhood. 

Reference is now made to Figure 3, which shows a general method of 
30 applying the sharpening filter to a digital image. A digital image is accessed 



-5- 



wo 02/27657 



PCTyiBOl/01805 



(block 102). The digital image may be accessed from a digital image file, the 
digital image may be received one or more lines at a time and processed in 
real time, etc. 

For each pixel of interest in the digital image (blocks 104, 114, 1 16), a 
5 neighborhood of pixels is determined (block 106), a dynamic range and 
contrast range of the neighborhood are determined (block 108), and the 
contrast stretching operation gCI) Is applied to the pixel of interest (block 110). 
Each filtered pixel is stored in a new file (block 112). Pixels lying at the 
boundaries of the digital image will have partial neighborhoods. These 
10 boundary pixels may be processed with respect to their partial neighborhoods, 
or the filtering may be ignored and the boundary pixels may be stored without 
modification. 

Not ail neighborhoods will have the same dynamic range (unless all 
pixels in the image have the same pixel Intensity value). Thus the dynamic 
15 range is variable. The contrast region, slope and mapping are all variable too. 

After the sharpening filter has been applied to the digital image, the 
sharpened image may be compressed and stored (block 118). Because the 
variable contrast stretching does not enhance noise and can even reduce low- 
amplitude noise, the variable contrast stretching does not reduce 
20 compressibility of the sharpened image. 

The compressed image may be accessed and decompressed at a later 
time. Since the compressed image is already sharpened, sharpening does 
not have to be perfomied on the decompressed image. Thus, sharpening on 
the image is performed only once; it is not performed each time the image is 
25 decompressed. 

Reference is now made to Figure 4. The variable contrast stretching 
may be implemented in hardware, software or a combination of the two. In 
generai, an image capture device 212 provides lines of a digital image to a 
processor 214. The processor 214 may store all of the lines of the digital 
30 image in memory 216 for sharpening at a later time, or it may sharpen the 
digital image in real time. The sharpened image may also be stored in the 
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memory 216. When sharpening the digital image, the processor 214 performs 
the filtering steps described in Figure 3. 

The amount of image blurring in the capture device 212 determines 
how much sharpening is needed. The constant R may be set by subjective 
5 quality tests. Different values for the constant R may be tested, and the value 
producing the most desirable image may be used. 

In a software implementation of the variable contrast stretching, the 
memory 216 stores a program that, when executed, instructs the processor 
214 to perform the filtering steps described in Figure 3. The processor 214 
1 0 and memory 21 6 may be part of a personal computer or workstation, they may 
be embedded in an image capture device, etc. 

A non-recursive algorithm may be used to determine the minimum and 
maximum values of pixel neighborhoods. The non-recursive algorithm may be 
used for all types of neighborhoods. The size of the memory needed to 
15 determine the minimum and maximum values is equal to the size of the 
neighborhood. 

A fast recursive algorithm may be used to determine the minimum and 
maximum values of full square neighborhoods (e.g., 3x3 neighborhoods, 5x5 
neighborhoods). Only twelve comparisons are needed to determine the 

20 maximum and minimum values, regardless of window size. If this recursive 
algorithm is used, the size of memory needed to buffer the lines is twice the 
size of the lateral kernel window. 

The variable contrast stretching can be performed in real time in raster- 
scan mode because there is a relatively small upper bound on the number of 

25 operations per scan line. Recursive and non-recursive algorithms may be 
used for real time operation. 

Although Figure 2 shows a 3x3 square-shaped neighborhood, the 
variable contrast stretching Is not limited to such a neighborhood. The 
neighborhood is not limited to any particular size. The number of pixels is not 

30 limited to nine. Although a fixed number of pixels in the neighborhood is 
preferred for all pixels of interest, the size of the neighborhood may be 
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changed dynamically to accommodate a particular class of Image region (e.g., 
text, graphics, natural features). 

The neighborhood Is not limited to any particular geometry, although 
square windows are preferred for performance reasons. For example, the 
5 shape of the neighborhood may be diamond-shaped. The minimum/maximum 
calculations may Include the center pixel (that is, a full neighborhood may be 
used) or the minimum/maximum calculations may exclude the center pixel of 
interest (that Is, a hollow neighborhood may be used), A hollow neighborhood 
might be preferred for images containing speckle-type noise. 

10 The variable contrast stretching may be "bootstrapped" onto another 

filtering method that determines minimum and maximum pixel intensity values 
for neighborhoods of pixels. This would allow the variable contrast stretching 
to be performed at virtually no additional overhead, since the main 
computational effort goes to computing the minimum and maximum values. 

15 For example, the variable contrast stretching may be bootstrapped onto a 
"despeckling" method that determines minimum and maximum pixel Intensity 
values for neighborhoods in which the center pixel (the pixel of interest) has 
been excluded. The despeckling method Is performed to clean speckle noise 
composed of isolated light pixels on a dark background and vice-versa. Thus 

20 both despeckling and variable contrast stretching may be performed, with 
virtually no additional overhead for performing the variable contrast stretching, 
The variable contrast stretching is not limited to linear mapping within 
the contrast range. Although linear mapping is preferred, non-linear mapping 
within the contrast range may be performed. 

25 Variable contrast stretching is not limited to documents including both 

text and natural images. It may be applied to images of any type, including 
images containing only text and images containing only natural features- If the 
variable contrast stretching is applied to Images that are entirely computer- 
generated (which images contain no low-amplitude noise), artifacts at sharp 

30 edges will not be produced. 

Although the variable contrast stretching has been described in 
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10 



15 



20 



connection with grayscale values, it is not so limited. The variable contrast 
stretching nnay be performed on multiple color planes. For example, the 
variable contrast stretching may be performed on images In RGB color space 
as follows. The color image is transformed to YCbCr color space. Sharpening 
is applied only to the luminance channel (Y) and the sharpened result is 
combined with unsharpened chrominance information, and the sharpened 
image is transformed from YCbCr color space back to RGB color space. 
Consequently, color fringes at the edges are not enhanced. These artifacts 
might occur if all three color planes are sharpened separately. 

The variable contrast stretching works well with a simple approximation 
for transforming the pixels from RGB color space to YCbCr color space and 
back to RGB color space. For example, the following transformations may be 
used. 



B^G^C^ 



These transformations are fast to compute, since all multiplications and 
divisions are performed by bit-shifting. Because the luminance channel is 
changed during sharpening, the transformation back to RGB color space 
might result in a color component that is outside of Its allowable range. Such 
a component may be clipped to its maximum or minimum allowable value 
(e.g., 0 or 255 for an 8-bit word). 

The present invention is not limited to the specific embodiments 
described and illustrated above. Instead, the invention is construed according 
to the claims that follow. 
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WHAT IS CLAIMED IS: 



1 . A method of processing pixel Intensity values of a digital image, the 
method comprising: 

clipping those pixel Intensity values outside of a variable range; and 
mapping those pixel Intensity values within the variable range. 

2. The method of claim 1 , wherein the variable range for each pixel is a 
function of dynamic range of a local pixel neighborhood, whereby the variable 
range is determined on a pixel-by-pixel basis. 

3. The method of claim 2, wherein the mapping is performed according 
to a slope that complies with the following: the slope approaches unity as the 
dynamic range approaches zero, the slope is greater than unity when the 
dynamic range is greater than zero, and the slope is a non-decreasing function 

5 of the dynamic range. 

4. The method of claim 3, wherein a contrast stretching operation is 
performed on each pixel of interest as follows: 

r/-A<-T1^ m 



g(/)= 



I-A>W M 
where m represents the minimum value of the neighborhood, M represents the 
maximum value of the neighborhood, D represent the dynamic range, D/(2W) 
represents the slope, I represents pixel intensity value, g(I) represents the 
contrast stretching operation, A represents the middle of the dynamic range, 
and 2W represents width of the contrast range, the contrast range being 
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centered about the middle of the dynamic range, the contrast range being a 
1 0 function of the dynamic range. 

5. The method of claim 4, wherein D/C2W) = 1 4-D/R, where R 
corresponds to dynamic scale for sharpening, whereby 

g(7)=/+^(/-A) for {\I-A\<W). 
R 

6. The method of claim 5, wherein R has a value that is constant for all 
pixels in the image. 

7. The method of claim 5, wherein a capturing device is used to 
provide the digital image; and wherein R is between one-quarter and twice a 
range that is normalized to cover the complete dynamic range of the capturing 
device. 

8. The method of claim 1 , wherein the digital image is a color image, 
and wherein a luminance channel of the image is sharpened by clipping those 
pixel intensity values outside of the variable range; and mapping those pixel 
intensity values within the variable range; and wherein the sharpened 

5 luminance channel is combined with chrominance information of the image. 

9. The method of claim 8, wherein the digital image is provided in RGB 
color space, and wherein the method further comprises using an 
approximation to convert the digital image from RGB color space to YCbCr 
color space prior to sharpening. 
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10. A method of sharpening a digital image, the digital Image Including a 
plurality of pixels of interest, for each pixel of interest the method comprising: 
determining a dynamic range for a pixel neighborhood; and 
performing contrast stretching according to the corresponding dynamic 

5 range; 

whereby the contrast stretching is performed on a pixel-by-pixel basis. 

1 1 .The method of claim 1 0, wherein the contrast stretching is 
performed on each pixel of interest by clipping a pixel intensity value lying 
outside a corresponding contrast range and mapping a pixel Intensity value 
lying within the corresponding contrast range, the contrast range being a 
5 function of the dynamic range. 

12. The method of ciaim 1 1, wherein the mapping is performed 
according to a slope that complies with the following: the slope approaches 
unity as the dynamic range approaches zero, the slope Is greater than unity 
when the dynamic range is greater than zero, and the slope is a non- 

5 decreasing function of the dynamic range. 

13. The method of claim 12, wherein a contrast stretching operation is 
performed on each pixel of Interest as follows: 



where m represents the minimum value of the neighborhood, M represents the 
5 maximum value of the neighborhood, D represent the dynamic range, D/{2\N) 
represents the slope, I represents pixel intensity value, g© represents the 
contrast stretching operation, A represents the middle of the dynamic range, 



I-A^-W 



m 



ga)= 



|/-a|<t^ 
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and 2W represents width of the contrast range, the contrast range being 
centered about the middle of the dynamic range, the contrast range being a 
10 function of the dynamic range. 

14. The method of claim 1 3, wherein D/(2W) = 1 + D/R, where R 
corresponds to dynamic scaie for sharpening, whereby 

g(/>i+^(7-A) for {|/-A|<W}. 
K 



15. The method of claim 14, wherein a capturing device Is used to 
provide the digital image; and wherein the value of R is between one-quarter 
and twice a range that Is normalized to cover the complete dynamic range of 
the capturing device. 



10 



16. A method of sharpening a digital image, the digital image including a 
plurality of pixels of interest, for each pixel of interest the method comprising 
performing the following contrast stretching operation on each pixel of interest 
as follows; 



g(/)- 



\I-A\<W 



2W 



I-A>W M 
where m represents the minimum value of the neighborhood, M represents the 
maximum value of the neighborhood, D represent the dynamic range, D/(2W) 
represents the slope, I represents pixel intensity value, gOO represents the 
contrast stretching operation, A represents the middle of the dynamic range, 
and 2W represents width of the contrast range, the contrast range being 
centered about the middle of the dynamic range, the contrast range being a 
function of the dynamic range. 
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17. Apparatus for processing pixels of interest in a digital image, the 
apparatus comprising a processor for determining dynamic ranges of pixel 
neighborhoods for the pixels of interest, and performing contrast stretching on 
each pixel of interest according to the dynamic range of the corresponding 

5 pixel neighborhood, whereby the contrast stretching is performed on a pixel- 
by-pixel basis. 

18. The apparatus of claim 17, wherein the processor performs the 
contrast stretching on each pixel of interest by clipping a pixel intensity value 
lying outside a corresponding contrast range and mapping a pixel intensity 
value lying within the corresponding contrast range, the contrast range being a 

5 function of the dynamic range. 



19. The apparatus of claim 18, wherein the mapping is performed 
according to a slope that complies with the following: the slope approaches 
unity as the dynamic range approaches zero, the slope is greater than unity 
when the dynamic range is greater than zero, and the slope Is a non- 
decreasing function of the dynamic range. 



20. The apparatus of claim 19, wherein a contrast stretching operation 
Is performed on each pixel of interest as follows: 
\I~A<-W 



\l~A\<W 



m 



2W 



I-A>W M 
where m represents the minimum value of the neighborhood, M represents the 
maximum value of the neighborhood, D represent the dynamic range, D/(2W) 
represents the slope, I represents pixel intensity value, gCI) represents the 
contrast stretching operation, A represents the middle of the dynamic range, 
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and 2W represents width of the contrast range, the contrast range being 
centered about the middle of the dynamic range, the contrast range being a 
1 0 function of the dynannic range. 

21 .The apparatus of claim 20, wherein D/(2W)= 1 + D/R, where R 
corresponds to dynamic scale for sharpening, whereby 

«(/)=/+^a-A) for {|/^^|<W}. 

22. The apparatus bf claim 21 , wherein an image capture device is used 
to provide the digital image; and wherein the value of R is between one- 
quarter and twice a range that is normalized to cover the complete dynamic 
range of the capturing device- 

23. Apparatus for sharpening a digital image, the apparatus comprising 
a processor for determining a contrast range for each pixel of interest in the 
digital image, clipping intensity value of a pixel of interest if the intensity value 
lies outside of a contrast range; and mapping the pixel intensity value if the 

5 pixel intensity value lies within the contrast range; whereby the contrast range 
is determined on a pixel-by-pixel basis. 

24. The apparatus of claim 23, wherein the contrast range for each pixel 
is a function of dynamic range of a local pixel neighborhood, whereby the 
processor determines the contrast range on a pixel-by-pixel basis. 

25- The apparatus of claim 24, wherein the mapping Is performed 
according to a slope that complies with the following: the slope approaches 
unity as the dynamic range approaches zero, the slope is greater than unity 
when the dynamic range is greater than zero, and the slope is a non- 
5 decreasing function of the dynamic range. 
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26. The apparatus of claim 25, wherein a contrast stretching operation 
is performed on each pixel of interest as follows: 

\I-A<-W 



m 



\I-A\<W 



A + (/-A) 

2W 



I-A>W M 
where m represents the minimum value of the neighborhood, M represents the 
maximum value of the neighborhood, D represent the dynamic range, D/(2W) 
represents the slope, I represents pixel intensity value, g(I) represents the 
contrast stretching operation, A represents the middle of the dynamic range, 
and 2W represents width of the contrast range, the contrast range being 
centered about the middle of the dynamic range, the contrast range being a 
function of the dynamic range. 



27. The apparatus of claim 26, wherein D/C2W) - 1 + D/R, where R 
corresponds to dynamic scale for sharpening, whereby 

g(i)=/+^(/-A) for {|/-A|<W}. 
R 

28. The apparatus of claim 27, wherein an image capture device is used 
to provide the digital Image; and wherein R is between one-quarter and twice a 
range that is normalized to cover the complete dynamic range of the capturing 
device. 
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29. An article of manufacture for a processor, the article comprising: 
computer memory; and 

an image sharpening program stored in the memory, the program, 
when executed, causing the processor to process pixels of Interest, each pixel 
5 of interest being processed by clipping its intensity value if its intensity value 
lies outside of a variable contrast range, and mapping its intensity value if its 
intensity value lies within the variable contrast range. 
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